Data Profile features.pkl

Dataset statistics

Number of variables	8
Number of observations	331
Missing cells	20
Missing cells (%)	0.8%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	35.7 KiB
Average record size in memory	110.4 B

Variable types

Numeric	8

Alerts

`prior_insutruction_reporting_frequency` is highly overall correlated with `prior_insutruction_reporting_frequency_scaled_by_max` and 2 other fields	High correlation
`prior_insutruction_reporting_frequency_scaled_by_max` is highly overall correlated with `prior_insutruction_reporting_frequency` and 2 other fields	High correlation
`unique_practice_questions_answered` is highly overall correlated with `prior_insutruction_reporting_frequency` and 2 other fields	High correlation
`unique_practice_questions_answered_scaled_by_max` is highly overall correlated with `prior_insutruction_reporting_frequency` and 2 other fields	High correlation
`proportion_of_prior_insutrction` has 20 (6.0%) missing values	Missing
`user_id` has unique values	Unique
`prior_insutruction_reporting_frequency` has 20 (6.0%) zeros	Zeros
`proportion_of_prior_insutrction` has 118 (35.6%) zeros	Zeros
`prior_insutruction_reporting_frequency_scaled_by_max` has 20 (6.0%) zeros	Zeros
`exam_points` has 4 (1.2%) zeros	Zeros

Reproduction

Analysis started	2024-09-15 18:30:47.033905
Analysis finished	2024-09-15 18:30:56.560601
Duration	9.53 seconds
Software version	ydata-profiling v0.0.dev0
Download configuration	config.json

user_id
Real number (ℝ)

UNIQUE

Distinct	331
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	46800.384

Minimum	257
Maximum	69968
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	2.7 KiB

Quantile statistics

Minimum	257
5-th percentile	11522.5
Q1	32484.5
median	56118
Q3	60575
95-th percentile	66229
Maximum	69968
Range	69711
Interquartile range (IQR)	28090.5

Descriptive statistics

Standard deviation	17681.555
Coefficient of variation (CV)	0.3778079
Kurtosis	-0.56023674
Mean	46800.384
Median Absolute Deviation (MAD)	8580
Skewness	-0.76235969
Sum	15490927
Variance	3.1263737 × 10⁸
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
42930	1	0.3%
58618	1	0.3%
59561	1	0.3%
59019	1	0.3%
59566	1	0.3%
15297	1	0.3%
59435	1	0.3%
11486	1	0.3%
58148	1	0.3%
11559	1	0.3%
Other values (321)	321	97.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
257	1	0.3%
427	1	0.3%
586	1	0.3%
4124	1	0.3%
4653	1	0.3%
5549	1	0.3%
7604	1	0.3%
7751	1	0.3%
8167	1	0.3%
8887	1	0.3%

Value	Count	Frequency (%)
69968	1	0.3%
69833	1	0.3%
69067	1	0.3%
69042	1	0.3%
68851	1	0.3%
68836	1	0.3%
68668	1	0.3%
68592	1	0.3%
68529	1	0.3%
68415	1	0.3%

prior_insutruction_reporting_frequency
Real number (ℝ)

HIGH CORRELATION ZEROS

Distinct	17
Distinct (%)	5.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	13.087613

Minimum	0
Maximum	16
Zeros	20
Zeros (%)	6.0%
Negative	0
Negative (%)	0.0%
Memory size	2.7 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	13
median	16
Q3	16
95-th percentile	16
Maximum	16
Range	16
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	5.2813162
Coefficient of variation (CV)	0.40353547
Kurtosis	0.77811678
Mean	13.087613
Median Absolute Deviation (MAD)	0
Skewness	-1.5466829
Sum	4332
Variance	27.892301
Monotonicity	Decreasing

Histogram with fixed size bins (bins=17)

Value	Count	Frequency (%)
16	229	69.2%
0	20	6.0%
15	17	5.1%
3	12	3.6%
7	6	1.8%
8	6	1.8%
9	5	1.5%
5	5	1.5%
4	5	1.5%
1	5	1.5%
Other values (7)	21	6.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	20	6.0%
1	5	1.5%
2	3	0.9%
3	12	3.6%
4	5	1.5%
5	5	1.5%
6	4	1.2%
7	6	1.8%
8	6	1.8%
9	5	1.5%

Value	Count	Frequency (%)
16	229	69.2%
15	17	5.1%
14	1	0.3%
13	2	0.6%
12	4	1.2%
11	4	1.2%
10	3	0.9%
9	5	1.5%
8	6	1.8%
7	6	1.8%

proportion_of_prior_insutrction
Real number (ℝ)

MISSING ZEROS

Distinct	37
Distinct (%)	11.9%
Missing	20
Missing (%)	6.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.31605606

Minimum	0
Maximum	1
Zeros	118
Zeros (%)	35.6%
Negative	0
Negative (%)	0.0%
Memory size	2.7 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0.16666667
Q3	0.58571429
95-th percentile	1
Maximum	1
Range	1
Interquartile range (IQR)	0.58571429

Descriptive statistics

Standard deviation	0.35510523
Coefficient of variation (CV)	1.1235514
Kurtosis	-0.95286937
Mean	0.31605606
Median Absolute Deviation (MAD)	0.16666667
Skewness	0.74092614
Sum	98.293436
Variance	0.12609972
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=37)

Value	Count	Frequency (%)
0	118	35.6%
1	20	6.0%
0.0625	18	5.4%
0.125	14	4.2%
0.9375	13	3.9%
0.875	13	3.9%
0.1875	12	3.6%
0.5625	10	3.0%
0.25	9	2.7%
0.5	9	2.7%
Other values (27)	75	22.7%
(Missing)	20	6.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	118	35.6%
0.0625	18	5.4%
0.06666666667	1	0.3%
0.07692307692	1	0.3%
0.09090909091	1	0.3%
0.1111111111	2	0.6%
0.125	14	4.2%
0.1666666667	1	0.3%
0.1875	12	3.6%
0.2	4	1.2%

Value	Count	Frequency (%)
1	20	6.0%
0.9375	13	3.9%
0.9333333333	2	0.6%
0.875	13	3.9%
0.8666666667	1	0.3%
0.8125	5	1.5%
0.75	4	1.2%
0.7142857143	1	0.3%
0.6875	7	2.1%
0.6666666667	3	0.9%

prior_insutruction_reporting_frequency_scaled_by_max
Real number (ℝ)

HIGH CORRELATION ZEROS

Distinct	17
Distinct (%)	5.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.81797583

Minimum	0
Maximum	1
Zeros	20
Zeros (%)	6.0%
Negative	0
Negative (%)	0.0%
Memory size	2.7 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0.8125
median	1
Q3	1
95-th percentile	1
Maximum	1
Range	1
Interquartile range (IQR)	0.1875

Descriptive statistics

Standard deviation	0.33008226
Coefficient of variation (CV)	0.40353547
Kurtosis	0.77811678
Mean	0.81797583
Median Absolute Deviation (MAD)	0
Skewness	-1.5466829
Sum	270.75
Variance	0.1089543
Monotonicity	Decreasing

Histogram with fixed size bins (bins=17)

Value	Count	Frequency (%)
1	229	69.2%
0	20	6.0%
0.9375	17	5.1%
0.1875	12	3.6%
0.4375	6	1.8%
0.5	6	1.8%
0.5625	5	1.5%
0.3125	5	1.5%
0.25	5	1.5%
0.0625	5	1.5%
Other values (7)	21	6.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	20	6.0%
0.0625	5	1.5%
0.125	3	0.9%
0.1875	12	3.6%
0.25	5	1.5%
0.3125	5	1.5%
0.375	4	1.2%
0.4375	6	1.8%
0.5	6	1.8%
0.5625	5	1.5%

Value	Count	Frequency (%)
1	229	69.2%
0.9375	17	5.1%
0.875	1	0.3%
0.8125	2	0.6%
0.75	4	1.2%
0.6875	4	1.2%
0.625	3	0.9%
0.5625	5	1.5%
0.5	6	1.8%
0.4375	6	1.8%

exam_points
Real number (ℝ)

ZEROS

Distinct	16
Distinct (%)	4.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	10.770393

Minimum	0
Maximum	15
Zeros	4
Zeros (%)	1.2%
Negative	0
Negative (%)	0.0%
Memory size	2.7 KiB

Quantile statistics

Minimum	0
5-th percentile	6
Q1	10
median	11
Q3	12
95-th percentile	14
Maximum	15
Range	15
Interquartile range (IQR)	2

Descriptive statistics

Standard deviation	2.6937356
Coefficient of variation (CV)	0.25010561
Kurtosis	3.6281119
Mean	10.770393
Median Absolute Deviation (MAD)	1
Skewness	-1.6069377
Sum	3565
Variance	7.2562117
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=16)

Value	Count	Frequency (%)
12	72	21.8%
11	65	19.6%
13	52	15.7%
10	35	10.6%
9	26	7.9%
14	24	7.3%
8	18	5.4%
7	12	3.6%
6	8	2.4%
15	6	1.8%
Other values (6)	13	3.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	4	1.2%
1	3	0.9%
2	1	0.3%
3	2	0.6%
4	2	0.6%
5	1	0.3%
6	8	2.4%
7	12	3.6%
8	18	5.4%
9	26	7.9%

Value	Count	Frequency (%)
15	6	1.8%
14	24	7.3%
13	52	15.7%
12	72	21.8%
11	65	19.6%
10	35	10.6%
9	26	7.9%
8	18	5.4%
7	12	3.6%
6	8	2.4%

exam_questions_attempted
Real number (ℝ)

Distinct	12
Distinct (%)	3.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	15.65861

Minimum	1
Maximum	32
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	2.7 KiB

Quantile statistics

Minimum	1
5-th percentile	16
Q1	16
median	16
Q3	16
95-th percentile	16
Maximum	32
Range	31
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	2.2646312
Coefficient of variation (CV)	0.1446253
Kurtosis	28.552395
Mean	15.65861
Median Absolute Deviation (MAD)	0
Skewness	-3.132256
Sum	5183
Variance	5.1285544
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=12)

Value	Count	Frequency (%)
16	317	95.8%
5	3	0.9%
4	2	0.6%
6	1	0.3%
32	1	0.3%
10	1	0.3%
15	1	0.3%
1	1	0.3%
2	1	0.3%
3	1	0.3%
Other values (2)	2	0.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	1	0.3%
2	1	0.3%
3	1	0.3%
4	2	0.6%
5	3	0.9%
6	1	0.3%
7	1	0.3%
10	1	0.3%
12	1	0.3%
15	1	0.3%

Value	Count	Frequency (%)
32	1	0.3%
16	317	95.8%
15	1	0.3%
12	1	0.3%
10	1	0.3%
7	1	0.3%
6	1	0.3%
5	3	0.9%
4	2	0.6%
3	1	0.3%

unique_practice_questions_answered
Real number (ℝ)

HIGH CORRELATION

Distinct	65
Distinct (%)	19.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	83.072508

Minimum	2
Maximum	98
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	2.7 KiB

Quantile statistics

Minimum	2
5-th percentile	19
Q1	86.5
median	96
Q3	98
95-th percentile	98
Maximum	98
Range	96
Interquartile range (IQR)	11.5

Descriptive statistics

Standard deviation	26.781397
Coefficient of variation (CV)	0.3223858
Kurtosis	1.5586393
Mean	83.072508
Median Absolute Deviation (MAD)	2
Skewness	-1.7304919
Sum	27497
Variance	717.24321
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
98	136	41.1%
96	91	27.5%
95	10	3.0%
6	4	1.2%
94	3	0.9%
15	3	0.9%
61	3	0.9%
25	2	0.6%
43	2	0.6%
50	2	0.6%
Other values (55)	75	22.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
2	1	0.3%
4	1	0.3%
5	1	0.3%
6	4	1.2%
7	1	0.3%
9	1	0.3%
10	1	0.3%
11	1	0.3%
12	1	0.3%
15	3	0.9%

Value	Count	Frequency (%)
98	136	41.1%
97	2	0.6%
96	91	27.5%
95	10	3.0%
94	3	0.9%
90	2	0.6%
89	1	0.3%
88	2	0.6%
87	1	0.3%
86	1	0.3%

unique_practice_questions_answered_scaled_by_max
Real number (ℝ)

HIGH CORRELATION

Distinct	65
Distinct (%)	19.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.84767865

Minimum	0.020408163
Maximum	1
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	2.7 KiB

Quantile statistics

Minimum	0.020408163
5-th percentile	0.19387755
Q1	0.88265306
median	0.97959184
Q3	1
95-th percentile	1
Maximum	1
Range	0.97959184
Interquartile range (IQR)	0.11734694

Descriptive statistics

Standard deviation	0.27327956
Coefficient of variation (CV)	0.3223858
Kurtosis	1.5586393
Mean	0.84767865
Median Absolute Deviation (MAD)	0.020408163
Skewness	-1.7304919
Sum	280.58163
Variance	0.074681717
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	136	41.1%
0.9795918367	91	27.5%
0.9693877551	10	3.0%
0.0612244898	4	1.2%
0.9591836735	3	0.9%
0.1530612245	3	0.9%
0.6224489796	3	0.9%
0.2551020408	2	0.6%
0.4387755102	2	0.6%
0.5102040816	2	0.6%
Other values (55)	75	22.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.02040816327	1	0.3%
0.04081632653	1	0.3%
0.05102040816	1	0.3%
0.0612244898	4	1.2%
0.07142857143	1	0.3%
0.09183673469	1	0.3%
0.1020408163	1	0.3%
0.112244898	1	0.3%
0.1224489796	1	0.3%
0.1530612245	3	0.9%

Value	Count	Frequency (%)
1	136	41.1%
0.9897959184	2	0.6%
0.9795918367	91	27.5%
0.9693877551	10	3.0%
0.9591836735	3	0.9%
0.9183673469	2	0.6%
0.9081632653	1	0.3%
0.8979591837	2	0.6%
0.887755102	1	0.3%
0.8775510204	1	0.3%

Auto

Heatmap
Table

	exam_points	exam_questions_attempted	prior_insutruction_reporting_frequency	prior_insutruction_reporting_frequency_scaled_by_max	proportion_of_prior_insutrction	unique_practice_questions_answered	unique_practice_questions_answered_scaled_by_max	user_id
exam_points	1.000	0.311	0.327	0.327	0.097	0.197	0.197	-0.014
exam_questions_attempted	0.311	1.000	0.299	0.299	-0.005	0.251	0.251	0.003
prior_insutruction_reporting_frequency	0.327	0.299	1.000	1.000	0.023	0.841	0.841	-0.020
prior_insutruction_reporting_frequency_scaled_by_max	0.327	0.299	1.000	1.000	0.023	0.841	0.841	-0.020
proportion_of_prior_insutrction	0.097	-0.005	0.023	0.023	1.000	0.058	0.058	0.183
unique_practice_questions_answered	0.197	0.251	0.841	0.841	0.058	1.000	1.000	0.047
unique_practice_questions_answered_scaled_by_max	0.197	0.251	0.841	0.841	0.058	1.000	1.000	0.047
user_id	-0.014	0.003	-0.020	-0.020	0.183	0.047	0.047	1.000

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows
Last rows

	user_id	prior_insutruction_reporting_frequency	proportion_of_prior_insutrction	prior_insutruction_reporting_frequency_scaled_by_max	exam_points	exam_questions_attempted	unique_practice_questions_answered	unique_practice_questions_answered_scaled_by_max
0	42930	16	0.3125	1.0	13	16	98	1.000000
1	61610	16	1.0000	1.0	9	16	98	1.000000
2	61835	16	0.0625	1.0	12	16	98	1.000000
3	49694	16	0.4375	1.0	12	16	96	0.979592
4	61693	16	0.6250	1.0	12	16	96	0.979592
5	257	16	1.0000	1.0	14	16	98	1.000000
6	25581	16	0.2500	1.0	8	16	98	1.000000
7	61659	16	0.0625	1.0	10	16	98	1.000000
8	61650	16	0.5000	1.0	12	16	96	0.979592
9	50259	16	0.0000	1.0	13	16	98	1.000000

	user_id	proportion_of_prior_insutrction	exam_points	exam_questions_attempted	unique_practice_questions_answered	unique_practice_questions_answered_scaled_by_max
321	34103	NaN	6	16	6	0.061224
322	40206	NaN	8	16	36	0.367347
323	39685	NaN	12	16	15	0.153061
324	12476	NaN	1	3	6	0.061224
325	27213	NaN	4	7	9	0.091837
326	27876	NaN	8	16	7	0.071429
327	26656	NaN	11	12	11	0.112245
328	48310	NaN	11	16	37	0.377551
329	48418	NaN	8	16	25	0.255102
330	53946	NaN	13	16	6	0.061224

Overview

Variables

Interactions

Correlations

Missing values

Sample